PAIRWISE RANKING: CHOICE OF METHOD CAN PRODUCE 
ARBITRARILY DIFFERENT RANK ORDER 



NGOC MAI TRAN 

Abstract. We examine three methods for ranking by pairwise comparison: Principal Eigen- 
vector, HodgeRank and Tropical Eigenvector. It is shown that the choice of method can produce 
arbitrarily different rank order. To be precise, for any two of the three methods, and for any pair 
of rankings of at least four items, there exists a comparison matrix for the items such that the 
rankings found by the two methods are the prescribed ones. We discuss the implications of this 
result in practice, study the geometry of the methods, and state some open problems. 



1. Introduction 

The problem of ranking appears in various contexts and forms. The choice of ranking method 
is often dictated by the format of the input data. Here we consider the following pairwise 
comparison model: suppose there are n items to be ranked. Let A denote the n x n pairwise 
comparison matrix, where Aij measures how much i dominates over j. These numbers are 
usually deduced from an experiment, opinion poll or voting behavior. The goal is to produce a 
cardinal ranking, one in which items are ranked based on a score vector a E M. n . 

Frequently in practice the comparisons are recorded on either a multiplicative scale 
(A^ = l/Aji,Aij > 0), or an additive scale (A^ = —Aji,Aij 6 M). We shall use the term mul- 
tiplicative paired comparison matrix (MPCM) and additive paired comparison matrix (APCM) 
to distinguish them. Both classes of matrices are found in various applications. The APCMs 
are sometimes derived from large-scale modern internet and e-commerce databases as a mean 
to give information on the ranking of items [JJ. Many other ranking models can also be casted 
in this framework, for example, the APCMs with entries restricted to {±1} are precisely the 
matrices appear in the standard scenario of binary pairwise comparisons [JJ. On the other hand, 
MPCMs, also called symmetrically reciprocal matrices [2j [3], are widely used in business and 
related fields. They were first suggested by Saaty [3], who proposed the Principal Eigenvec- 
tor method for obtaining a score vector from these matrices, and used them in the Analytic 
Hierarchy Process for multi-criteria decision making. 

Throughout this paper we shall reserve A to indicate an APCM, and X to indicate an MPCM. 
Given the natural one-to-one correspondence between these two classes of matrices via taking 
elementwise log/exponential, we shall state definitions in terms of an APCM A only, with the 
corresponding definition for an MPCM (Xij) = (exp fe (Aij)) implied, where b ^ can be any 
choice of exponent base. Following [5], we say that a paired comparison matrix A is strongly 
transitive if 

A ik = A^ + A jk for all i, j, k, 

and say that A is transitive if 

A^, Ajk > => A ik > 0. 

Note that in either cases the task of retrieving an ordinal ranking is trivial. Furthermore, strong 
transitivity implies the existence of a unique cardinal ranking up to constants |3J: 

A is strongly transitive 44> Ay = ai — aj (1) 

for some a £ W 1 unique up to an additive constant. 

l 
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Here a% has the natural interpretation of being the score assigned to the i item relative to some 
reference point, corresponding to the additive constant. In practice A is likely to be corrupted 
by noise, or obtained from averaging the opinion of multiple individuals, and therefore may not 
be strongly transitive nor transitive. Equation Q shows that finding a score vector is equivalent 
to approximating the observed matrix by a strongly transitive matrix. One can formulate this 
as follows. 

Problem. Suppose that there is an unknown true score vector s £ M. n which induces a strongly 
transitive additive comparison matrix S, and that we observe a noisy APCM A, where 

A = S + e (2) 

for some noise matrix e. Can we recover the true score vector s up to an additive constant, or 
at least up to the same induced ranking? 

A similar formulation holds for MPCMs. A number of methods for estimating s have been 
proposed in the literature, some are designed specifically for MPCMs [21 HI IB]; while others are 
for APCMs p]. In general these methods can produce different rankings, and the choice of 
method remains a topic of debate. A number of interesting questions arise: when and how often 
do these methods produce different rankings? Can they produce 'very different' rankings? Does 
the format of the data (APCM or MPCM) matter? If one wants to convert from one type to 
another, does the choice of base b in defining the log/exponential map matter? 

In this paper, we aim to answer the above questions for three specific methods commonly 
used in practice: Principal Eigenvector, HodgeRank and Tropical Eigenvector. Some properties 
of the first two have been studied and compared in the literature [H 01 [61 [7] . Our main result is 
the following. 

Theorem 1.1. For n > 4, for any two of the above three methods, given any pairs of rank order 
(o~i,o~2), there exists a paired comparison matrix A such that the first method applied to A gives 
the ranking o~\, and the second method applied to A gives the ranking o~2 on the n items. 

This result is somewhat surprising and may remind the reader of Arrow's Impossibility The- 
orem in social choice theory. In particular, it implies that these methods are fundamentally 
different, and the choice of methods in practice deserves further study. 

The paper is organized as follows: in Section [2j we describe the three methods, their known 
properties, and their connections. We state some lemmas concerning their behavior under 
permutation of items, scaling and perturbation of the matrix A. These will be used to prove 
Theorem |1.1[ but they are also interesting in their own rights. In Section [3| we study the 
geometry behind our theorem, which is revealed to be strongly connected to the geometry of 
the Tropical Eigenvector. We compute an explicit formula for the Tropical Eigenvector when 
n = 4. In Section [4j we prove Theorem |1.1| and discuss the problem of realizability for ranking 
triples. Section [5] describes some open problems. 

2. The three methods 

Notations. Let A denote the set of APCMs, which are n x n skew-symmetric matrices, 
let ST C A be the subspace of strongly transitive APCMs. Let X denote the set of MPCMs. 
For a matrix X, let v(X), h(X), m(X) denote the principal eigenvector, HodgeRank vector, 
and tropical eigenvector of X, respectively. These will be defined below. Let X^ denotes 
the k th Hadamard power (X^ = Xfj). For two matrices X and Y, let X o Y denote their 
Hadamard product: (X o Y)™ = XijYij. As an abuse of notation we shall also use A to indicate 
the vector (Aij : i < j), since it should be clear from context. By the Loo-norm of A we 
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mean ||j4||oo = m a x ij an d the L2-norm of A is ||^4||2 = yY2i j Ajj- For M G ST, let M := 
— (M12, • • • , Mi n ) be the last n — 1 coordinates of the score vector m of M, normalized so mi = 0. 
For any set S C ST, define ~S = {M,M G S}. For A £ A, the graph of A is the directed graph 
where Aij is the weight of the edge from i to j. For a cycle 7r : *i — > 22 — ^ ■ • • — ^ *fc — ^ i-k+i = H, 
the cycle value f(ir) is defined to be the sum of the corresponding edges: f(ir) := ^ • Ai j i j+1 . 

As we shall prove (Lemma 2.2 part 1), all three methods are invariant under relabeling of 
the items. Therefore, we shall think of a ranking as a permutation, that is, an element of 
the symmetric group on n letters S n . For a generic vector w G W 1 , let r(w) G S ra denote its 
induced ranking. Say that A induces a ranking triple {a\, o~i, 03) for (v, h, m) if r(v) = o~i,r(h) = 
a2,r(m) = (T3. Say that a ranking triple a = (01, 02, 03) £ §n is realizable for (v, h,m) if there 
exists a matrix ^4 which induces that ranking triple. Definitions for the ranking pairs follow 
similarly. 



2.1. Principal Eigenvector. For X G X, note that JQ,- > for all i, j, therefore its principal 
eigenvector v(X) is real and unique by the Perron- Frobenius theorem, and is used as an estimator 
for the score vector in this method. 

Since its existence only relies on the non- negativity of the matrix entries, the Principal Eigen- 
vector method is also used in ranking contexts other than paired comparisons. For example, in 
Google's PageRank algorithm, one starts with a matrix that essentially consists of transition 
probabilities between webpages of a random web surfer and uses its principal eigenvector for 
ranking webpages. The specific application of Principal Eigenvector to MPCMs first appeared in 
the Analytic Hierarchy Process [3] , where it is utilized to obtain the score vector at intermediate 
steps in the hierarchy. 

The Principal Eigenvector has a Bayesian interpretation: given a prior score vector p G W+, 
we can think of Xp as the posterior score, since 

{Xp)i = XijPj = sum over all j of how much i wins j, weighted by our prior pj. 

j 

Then the Principal Eigenvector v(X) is the Bayesian solution to the ranking problem, since, as 
an element of the projective space PR n_1 it is invariant under further updates by X. 



2.2. HodgeRank. Here one equips the linear space A with the usual matrix inner product. 
The HodgeRank vector h(A) is the score vector of the L2 projection of A onto the subspace ST. 
That is, it minimizes the L2-norm of the error e in Equation ([2]). It admits a simple formula. 

Lemma 2.1. [6, Theorem 3] Let A G A. Then, up to an additive constant, the HodgeRank 
vector h(A) is given by the normalized row sum of A. 

h(A) = — A ■ 1 
n 

where 1 is n x 1 column vector consists of 1 's. 

Proof. Let H G ST be the strongly transitive matrix defined by h. It is sufficient to show that 
tr((^4 — H) T W) = for all W G ST. Let w be a score vector of W. Let ri,a denotes the i th 
row and column sum of A, respectively. Note that Ci = —ri since A is skew-symmetric. Then 

tr((A - HfW) = (> - £ + r {) K - W] ) 

i 3 

= Wi{ri -n)-^2 Wj(cj + rj) = 0. □ 

» j 
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Lemma 2.1 indicates that one can also apply HodgeRank to an MPCM, in which case the i th 
entry of the score vector is the geometric mean of the i th row. This was first noticed by Crawford 
[6], who proposed the name 'row geometric mean', or 'log least square estimator'. The name 
'HodgeRank' was proposed by Jiang et al. [T] who approached the problem using combinatorial 
graph theory. In this case the entries A^j are viewed as edge flows from node i to node j, 
and the score vector is the potential of the nodes. Entries of h(A) can be interpreted as the 
average outflow from each node, which is an intuitive measure of its potential. This method 
has a number of appealing properties both computationally and mathematically, as studied in 
details in [I]. For example, it is the maximum likelihood estimator for s under certain classes 
of statistical models on the error term e. The special case of multiple raters with i.i.d normal 
error was discovered earlier by Crawford [6]. 



2.3. Tropical Eigenvector. This ranking method was suggested by Eisner and van den Driess- 
che [2]. Here, one considers A under the max-plus algebra (R, ©, 0), where xOy = max{x, y}, xQ 
y = x + y. If a pair (\ ma x, m) elxK™ satisfy 

A m = \ max m 

where the matrix multiplication is performed in the max-plus algebra, then it is called a tropical 
eigenvalue-eigenvector pair of A. It is known (see, for example, 019]) that if A is irreducible, 
then Xmax is unique, and it is equal to the maximal normalized cycle length of the graph of A, 
that is, 

Xmax — max — (^Aj yl i 2 ~\~ Ai 2 is ~\~ • • • ~\~ Ai k _ 1 i k + Ai k i-^j . 

{u,...,j fc }C{l,...,n} K 

Note that this value can be attained by more than one cycle in A. Such cycles are called 
critical cycles, and their vertices are called critical vertices [2|. One can also apply this method 
to an MPCM X by considering it under the tropical max-times algebra (K, ©, •) : x © y = 
m&x{x,y},x-y = xy as in [2]. Then, the tropical max-times eigenvector v max (X)i = exp b m(A)i 
serves as an estimator for the true score vector. It is easy to see that different choices of the 
exponent base b amounts to different scalings of v ma x, and therefore preserves the induced 
ranking. 

In the Tropical Eigenvector method, one uses the tropical eigenvector m(A) as an estimator 
for the true score vector s. For all matrices A £ A, \ m ax is always unique, and m(A) is unique 
if and only if the critical cycles of A are not disjoint [21 110J . This is a very mild condition: the 
set of matrices with non-unique critical cycles is a finite union of disconnected polyhedral sets 
of measure under the Lebesgue measure on A. For 'general' A (that is, for most reasonable, 
generic distributions on the noise e), X m ax is almost surely attained by only one cycle, and hence 
the uniqueness (up to tropical scaling) of m is guaranteed almost surely. 

2.4. Properties of the three methods. From now on, we shall assume that the matrix A 
under consideration has a unique tropical eigenvector. In this section, we state a collection of 
results concerning the behavior of these estimators under permutation of the labeling of the 
items, scaling and perturbation of the matrix A. The proof relies on some properties of the 
tropical eigenvector, and is therefore deferred to Section |3.4| Here we shall focus on interpreting 
its implications. In particular, we address the issue of choice of exponent b when converting 
between APCMs and MPCMs. 

Lemma 2.2. (1) All three methods are invariant under relabeling of the items. 
That is, for r £ §„, let [r] denotes the permutation matrix that maps the vector [12 ... n] to 
[t(1)t(2) . . . r(n)]. If A induces the ranking triple {a\, 02, 03), then Y := [t]^4[t -1 ] induces the 
ranking triple (to~\, toi, Ta^). 
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(2) HodgeRank and Tropical Eigenvector are invariant under multiplication of A by scalars, 
or taking Hadamard powers of X. Principal Eigenvector does not have this property. That is, 
for any constants c ^ 0,k > 0, for A £ A and X £ X , we have 

h{c-A) = h{A) h(X^) = h(X) k 
m(c • A) = c ■ m(A) m{X (k) ) = m{X) k 

(3) HodgeRank is additive in A and Hadamard multiplicative in X. Principal Eigenvector 
and Tropical Eigenvector are Hadamard multiplicative in X with strongly transitive matrices. 
That is, if A, A' € A and X, X' G X , then for all i, 

h{A + A')i = h{A)i + h(A% h(X o X')i = h(X)ih(X')i 

If in addition A and X are strongly transitive, then for all i, 

m(A + A')i = m(A)i + m(A% m(X o = m(X)im(X')i, 

and v(X o X')i = v(X)iv(X')i. 

Implications on conversion between APCMs and MPCMs 

For fixed b, consider the isomorphism from A to X defined via 

A ^ X := (X i:j ) = (exp^Aij)). 

Note that exp b (Aij) = exp(log(fc)-Ay). Since HodgeRank and Tropical Eigenvector are invariant 
under scaling, the choice of b does not changes the induced ranking. Multiplying Aij by a 
constant corresponds a change of measurement scale, and therefore it is desirable that the 
ranking does not change when one changes measurement unit. Hence, in considering the induced 
ranking of HodgeRank and Tropical Eigenvector, one can work entirely in A and utilize its inner 
product space structure, and then lift to X via taking element-wise exponential using any base, 
and vice versa. 

However, one cannot do the same with Principal Eigenvector, since Lemma [2.2| part 2 indicates 
that the choice of b affects the ranking. This does not imply that the method depends on the 
measurement unit: in fact, since the entries of X measure the ratio between two scores, they 
are by default unit-free. The lack of scale invariance of Principal Eigenvector simply means 
that the method is not designed for additive paired comparison data. In general, if a ranking 
method is invariant under all monotone transformations of the entries of A (or X), then it must 
be a method that only take into account the signs of the entries of A, that is, A^ 6 {±1,0}. 
In this case, it only makes sense to ask for an ordinal and not cardinal ranking. Therefore, in 
working with cardinal ranking, any method lacks the invariance property under some monotone 
transformations of the data. The bottom line is, for Principal Eigenvector, one should always 
work with MPCMs, while HodgeRank and Tropical Eigenvector can be applied to both MPCMs 
and APCMs. However, as we shall see in Section |3j there is a version of Principal Eigenvector 
on APCMs, and this turns out to be the Tropical Eigenvector. 

3. Geometry of the methods 

In the first part of this section, we shall see that Tropical Eigenvector on X can be interpreted 
as the scale-invariant limit of Principal Eigenvector, and Tropical Eigenvector on A has the 
geometric interpretation of being a special point on the set of Loo-minimizers of e from A to 
ST, thus is related to HodgeRank, which is the L2-minimizer of e. Therefore, the Tropical 
Eigenvector serves as a bridge connection the other two methods. The rest of the section will be 
devoted to looking at the geometry of Tropical Eigenvector in general and for n = 4 in particular. 
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3.1. Tropical as Principal Eigenvector on A. Suppose one wants to apply Principal Eigen- 
vector to APCMs. Then one seeks for a scale-invariant version of this method, and interestingly, 
the Tropical Eigenvector is the answer. This interpretation is based on the following result of 
Gaubert et al. |11| . 

Corollary 3.1. [H] If the max-times tropical eigenvector v max (X) of X £ X is unique, then it 
can be obtained as the limit of the principal eigenvector of Hadamard powers of X. That is, 

v max = Km KlW)) 1 ^ 

where v(X^) denote the principal eigenvector of X^ k \ 

One could interpret this in the context of rank aggregation as follows: suppose there are k 
raters who produce identical pairwise comparison matrices 

A = A 1 = ... = A k . 

If one uses Principal Eigenvector to obtain an overall ranking by averaging the score of the 
total preferences (aggregated by taking Hadamard product of the individual matrices), then one 
obtains the tropical eigenvector in the limit as the number of raters k — > oo. This gives Tropical 
Eigenvector the interpretation of being 'Principal Eigenvector on APCMs'. 

3.2. Tropical as Loo minimization on ^4. Let Da be the set of Loo-minimizers from A to ST, 
let trop(A) = {m G W 1 : AQ m = X m ax(A) m} denote its tropical eigenspace. A restatement 
of Theorem 2 in [12] gives the following. 

Corollary 3.2. |12j The max-plus eigenvalue X ma x(A) is the Loo distance between A and the 
subspace ST, and the tropical eigenspace of A is a subset of the score vectors of Loo-minimizers 
from A to ST- That is, 

trop(A) C Da- 

In particular, one tropical eigenvector of A is given by 

rrij = min{u>j : w £ Da} = raax{Wij : W G Da}- (3) 

In other words, the upper right corner with respect to the standard basis on A of the polytope 
Da is always a tropical eigenvector. 

Corollary |3 . 2| makes the link between HodgeRank and tropical max-plus eigenvector clear: the 
former is the L2-minimizer, while the later is the upper right corner in the set of Loo-minimizers 
from A to ST when it is unique. A complete characterization of cases where trop(A) = Da 
is not yet known. One such instance is when Da is a point, and this occurs if and only if the 
unique critical cycle of A is an n-cycle |12j . 

3.3. Geometry of the Tropical Eigenvector. Both HodgeRank and Tropical Eigenvector 
rely on the orthogonal decomposition A = ST © ST ± - Therefore, in studying the geometry 
of these methods, it is beneficial to work with a basis of A which reflects this decomposition. 
Saari |5j proposed a natural basis for ST and identified a spanning set for ST ± - Here, we shall 
extend his work by showing that there is also a natural choice of basis for ST ± ■ The following 
results were stated in [5J using different terminologies. 

Lemma 3.3. [5J Regard A as Rw, so A = (Aij,i > j) £ A is a vector. 

A basis for ST: For i G {1, . . . , n}, define U G {±1, O}^) to be the vector such that 

(ti,A) = the i th row sum of A viewed as a skew- symmetric matrix, 
where (•, •) is the usual inner product in IRu) . 

Then any subset of n — 1 vectors from the set {t\, . . . , t n } defines a basis for ST. 
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A spanning set for ST : Fix a vector A 
s{ir) G {±1,0} (2) to be the vector such that 

Then the set S consisting of all vectors s(ir), 



G A. For each cycle tt in the graph of A, define 
■■(*(*), A). 

where ir is a cycle in the graph of A, spans ST 1 ' ■ 



The cardinality of S, which is the number of fc-cycles for 3 < k < n is much greater than ( n 2 , 
the dimension of ST^~. Clearly any linearly independent subset of size C^ 1 ) would be a basis. 
We note that there is a natural choice: namely, the set of 3-cycles involving a fixed vertex v. 

Lemma 3.4. A basis for ST Fix a vertex v. Let 

S v := {s(tt) G {±1,0}(2) :tt is a 3-cycle with 7r(l) = v} 

Then S v has 2 x ("g 1 ) vectors which occur in pairs of the form (s(tt), —s(tt)). Pick one repre- 
sentative for each pair. Then the resulting set is a basis of ST 1 ^ ■ 

Proof. The cardinality of S v is 2 x ("^ 1 ) since there are two choices for the other two nodes to 
complete an undirected 3-cycle. Note that any fc-cycle tt involving the node v can be graphically 
represented by a planar fc-gon, which we shall call the graph of tt. Since A as a matrix is 
skew-symmetric , 

fc-2 
3=1 

where {tj G S v : j = 1, . . . , k — 2} is a triangulation of the graph of tt. It follows that S v spans 
the set of all fe-cycles involving v. On the other hand, the graph of tt can also be triangulated by 
fixing another vertex v' . Since the choice of cycle is arbitrary, it follows that any other 3-cycle 
involving v' is also in the span of S v . An inductive argument shows that S v spans S, completing 
the proof. □ 

The following corollary comes from a direct computation and gives the geometric interpretation 
of the tropical max-plus eigenvector of A. 

Corollary 3.5. Fix A £ A, viewing it as a vector in r( 2 ). The projection of the standard cube 
centered at A onto ST is the (n — \)-permutahedron, scaled by 1/n and centered at h{A). Its 
dual zonotope Z± , which is the projection of the standard cube centered A onto ST 1 ' , is a convex 
symmetric polytope centered at A — P{A), where P(A) is the orthogonal projection of A onto 
ST. The distance in ST 1- from the center of Z± to is X m ax(A). Furthermore, the facet (s) of 
^max(A) ■ Z± which contain are precisely the critical cycle(s) of A. 

The zonotope Z±_ is the cographic zonotope associated with the complete graph on n nodes 
(see, for example, |13j). It exhibits much symmetry, since actions of S n on the labeling of the 
items correspond to rotations of Z±. While the corollary applies independent of the choice of 
coordinate on ST 1- , in visualizing Zj_ some basis may expose the symmetry induced by the 
actions of S n better than others. This is demonstrated in the following example. 

Example 3.6. Let n = 4. Here dim(5T) = dim(5T" L ) = 3. We shall equip ST 1- with a basis 
consisting of 4-cycles. There are six 4-cycles in §4 and they occur in pairs of the form (cr, c _1 ). 
Choose a representative for each pair. Then the resulting set consists of 3 independent 
vectors in M 6 , and they form a basis for ST 1- . For concreteness, we shall choose to be the 
set {/i,/2,/3}, with 

/i = s((1234)), / 2 = s((1342)), f 3 = s((1423)), 
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where s(ir) of a cycle ir is the unique vector defined in Lemma 3.3 Explicitly, 

/i = s((1234)) = (1,0,-1,1,0,1) 
/ 2 = s((1342)) = (-1,1,0,0,-1,1) 
/ 3 = s((1423)) = (0,-1,1,1,-1,0). 

Since if we regard A as the R 6 vector (Ai 2 , A13, An, A23, A24, -A34), then 

{h,A) = A12 - A 14 + A 23 + A 34 = A12 + A 23 + A 34 + A 41 

which is the value of the cycle (12 3 4). The computation for / 2 and can be checked similarly. 
The zonotope Z± expressed in this basis is shown in Figure [TJ 




Figure 1 . Z± with regions colored according to the two cases, up to permutation 
of the labellings of the items. 



Note that Z± is also a permutahedron; this is due to the complete graph on 4 elements being 
self-dual, therefore the graphic and cographic zonotope of Corollary |3 . 5 1 ar e isomorphic. Z± has 
8 hexagonal facets colored red, corresponding to the eight 3-cycles, and 6 square facets colored 
green, corresponding to the six 4-cycles. The value and critical cycle of the tropical max-plus 
eigenvalue X ma x is determined by entirely by the facet of X max ■ Z± that contains 0. Each facet is 
further subdivided into regions corresponding to different formulae for the tropical eigenvector. 
Three such regions are labeled rl,r2,r3 in Figure [TJ This subdivision is due to the fact that 
the tropical eigenvector is sensitive to permutation of the labeling of the items that fixes the 
critical cycle. Hence, the square facet is subdivided into 4 regions, while the hexagonal facet is 
subdivided into 3 regions. Modulo permutation of items, there are only two formulae for the 
tropical eigenvalue and tropical eigenvector, one for each facet type. To obtain their explicit 
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formulae from Figure [TJ we only need to know the equations denning boundaries of the facets 
and their subdivisions. The equations 

{fx,A) = 0,{f 2 ,A)=0,{f 3 ,A)=0 

are three gray planes with orange boundary, defining the three edges shared by adjacent hexagons. 
The equations 

2((f 2 ,A) + (f 3 ,A)) = (f u A),2((f 1 ,A) + (f 3 ,A)) = (f 2 ,A),2((f 1 ,A) + (f 2 ,A)) = {f 3 ,A) 

define the other three edges of the hexagon. Only the edge cut out by the first equation is shown 
here in yellow. The black lines subdividing the frontal hexagon into three regions are 

2(/i ) A) = (/ 2 ,A) + (/3 ) A),2(/ 2 ,A) = (/i ) A) + (/3,A) ) 2(/ 3) A) = (/ 1 ,A) + (/ 2 ,A). 

One can compute and see that the frontal hexagon corresponds to the 3-cycle (2 3 4), and the 
three green squares perpendicular to the axes /i, / 2 , / 3 correspond to the three 4-cycles defining 
these vectors. One can also read off the formula for X max (A) in terms of the cycle values and 
the inequalities defining the regions, as demonstrated below. 

Formulae for the tropical eigenvalue. 

Suppose (/i, A), (/ 2 , A), (f 3 ,A) > 0. This means lies in the triangular region bounded by the 
orange lines. If 

(A, A) >2-((/ 2 ,A) + (/ 3 ,A}) or 

</ 2 ,A) >2.«/i,A) + </ 3! A» or 

{fa, A) >2-«/i,A) + (/ 2 ,A», 

which implies that lies in one of the three small triangles outside of the hexagon, then the 
4-cycle corresponding to fx (or f 2 , or f 3 , respectively) is a critical cycle of A, and 



Xmax(A) = ^«/i,A» or ^((/ 2 ,A)) or -((/ 3 ,A)), respectively. 



If 



(/ 1 ,A)<2-((/ 2 ,A) + (/ 3 ,A)) and 
(/ 2 ,A)<2-((/ 1 ,A) + (/ 3 ,A)) and 
(/ 3 ,A)<2-((/ 1 ,A) + (/ 2 ,A)), 
which implies that lies in the hexagon, then the 3-cycle (2 3 4) is a critical cycle of A, and 

Xmax(A) = h{h, A) + (f 2 , A) + (/ 3 , A)). 

D 

Formulae for the tropical eigenvector. The tropical eigenvector can also be read off from Z±. 
Here we give explicit formulae for the red region marked rl and the green region above it. 

• The red region rl: this region is defined by (/i,A) > (f 2 , A) , (f 3 , A) > 0, 2((/ 2 ,A) + 
(/ 3 , A)) > {fx, A), 2/ 2 < {fx, A) + </ 3 , A), and 2 fx > (f 2 , A) + (f 3 , A). In this case, 

"000 
1-15 2 
12 -2 7 1 

-3 6 3 



m(A) = h(A) + 



(A, A) 
</2,A> 

</3,A> 



The green region above rl: this region is defined by {fx, A) > (/ 2 , A), (f 3 , A) > 0, and 
2((/ 2 , A) + </ 3 , A» < {fx, A). In this case, 



m(A) = h(A) + 



1 

12 





3 

3 





{h,A) 
</2,A) 
</3,A) 
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Formulae for the tropical eigenvalue and eigenvector for other regions can be obtained by per- 
muting the labels of the vertices, corresponding to rotating the zonotope. For example, if one 
acts on the labellings of the items by a = (4 2 3), then 



a({f 1 ,A)) = a(A 12 + A 23 + A u + A 41 ) 
<r((/ 2 , A)) = a(A 13 + A 34 + A 42 + A 21 ) 
cr((f 3 ,A)) = a(A u + A 42 + A 23 + A 3l ) 



A l3 + A u + A 42 + A 2l = (/ a , A) 
A u + A 42 + A 23 + A 31 = (f 3 , A) 
A 12 + A 23 + A 34 + An = (/i , A) . 



Therefore, the action of a on the label of items corresponds to a counter-clockwise 120° rotation 
of Z\_ around the center of the hexagonal facet in the picture. The red region rl is mapped to 
region r2, and the formula for the max-plus eigenvector in this region is 



m(A) = h{A) + 



12 





-3 6 
-1 5 
-2 7 



(h,A) 
(f2,A) 

ih,A) 



Note that in th example m(A) — h(A) only depends on the ST 1 ' component of A. This is 
true in general, and is linked to the geometric relationship between Tropical Eigenvector and 
HodgeRank. 

Lemma 3.7. Let P(A) be the L 2 -projection of A onto ST. Then the tropical eigenvalue of 
A — P{A) is Xmax(A), and its max-plus eigenvector is m(A) — h(A). 



Proof. Note that A max (^4) is the tropical max-plus eigenvector of A if and only if for all i, 



max(Aij - (mi - rrij)) = X max (A). Since P(A)ij 

j 



hi — hj, we have 



Amax(-4) = max {(A - P{A))ij + (hi - hj) - (mi - nij)} for all i 

j 

= max {(A - P(A))ij - [(m - h)i - (m - h)j}} for all i. 
Hence m(A) — h(A) is the max-plus eigenvector of A — P(A). 



□ 



3.4. Proof of Lemma 2.2 Part (1) follows from a direct computation. Statements on the 
HodgeRank vector follows from Lemma |2.1| We shall prove the stated results for the tropical 
eigenvector and principal eigenvector. 

Since the entries of the tropical eigenvector are piecewise linear in terms of the entries of A, 
m(cA) = cm(A). If A is strongly transitive, then the ST 1 ' component of A is zero, hence 
m(A + A') - h(A + A') = m(A') - h(A') by Lemma [3TT} But h(A + A') = h(A) + h(A') = 
m(A) + h(A') since A G 57", hence m(A + A') = m(A) + m(A'). The corresponding statements 
for X £ X follow. 



Example 4.4 in Section [4] shows that the Principal Eigenvector does not have property (2). To 
prove (3), suppose the matrix X' is strongly transitive with score vector s. Then (X o X = 
XijSi/sj. Multiplying out, we see that the vector vs with (vs)i = UjS, is an eigenvector of X oX' 
with positive entries, hence it is the principal eigenvector by Perron-Frobenius theorem. □ 



4. Proof of Theorem 11.11 

Lemma 4.1. (1) To prove Theorem 1 for HodgeRank and Tropical Eigenvector, it is sufficient 
to find one matrix A £ A such that h(A) = (0, . . . , 0), and m(A) induces a ranking without ties. 
(2) To prove Theorem 1 for Tropical and Principal Eigenvector, it is sufficient to find one 
matrix X E X such that m(X) = (!,...,!) and v(X) is a ranking without ties. 
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Proof. For (1): suppose A is such a matrix. Fix a ranking a. By invariance under relabeling 
of items, it is sufficient to find a matrix B such that r{m{B)) = r(m{A)) and r(h(B)) = a. 
Consider 

B := A + e • W for some e > 0, W E ST such that r(h(W)) = r(m(W)) = a 

By Lemma |2.2[ m(B) = m(A) + e • m(W), hence for e sufficiently small r(m(B)) = r(m(A)), 
while r(/i(5)) = r{h{W)) = a. □ 



For (2): suppose X is such a matrix. Let M £ A 1 be a strongl y tr ansitive matrix with r(v(M)) 



r(m(M)) = a. For k > 0, let Y := X o M^. By Lemma [gjj m(Y) = m(X) o (m(M) k ), so 
r(m(Y)) = r{m(M)) = a. It would be sufficient to show that one can choose k small enough 
such that r(v(Y)) = r(v(X)). 

Indeed, from classical results in linear algebra (see, for example, [H]), the largest eigenvalue of 
X is a continuous function in its entries, hence is also a continuous function in its upper-diagonal 
entries when X E X. Furthermore, since A has multiplicity 1, any column of the adjugate matrix 
adj(X — AI) is a principal eigenvector, where I is the identity matrix. Since each entry of this 
matrix is a cofactor of an entry in X — AI, each v% is a polynomial in A and entries of X. Let 
e = min \vi(X) — Vj(X)\. Since there are only finitely many v^s, one can find a 5 > such that 

y 

the ordering of the v^s are preserved when each upper-diagonal entry of X is perturbed by e 5 . 
Hence k = 5/log(||M||oo) would do. □ 

Proof of Theorem 11.11 

For HodgeRank and Tropical Eigenvector 

We shall construct the matrix A in Lemma k.ll as follows: start with a matrix A' such that 

• (1) h(A') = 0. 

. (2) A' 12 > A> 23 >...> A' {n _ 1)n > A' nl > 0. 

• (3) For n := , we have 7^ A* for all i. 



11 



Such a matrix A' exists since dim(»4) > n for all n > 3. Let A := A' + k- B, where B E A is the 
matrix with upper diagonal entries 

Bij+i = 1 for all i < n — 1, B\^ n = — 1, = else. 

Note that A satisfies properties (1) to (3), and for sufficiently large k, the following also hold. 

• (4) For each row i, maxj Aij = Aj^u^y 

• (5) A max = ji. That is, the n-cycle 1— > 2 — y ... — > n — >• 1 is a critical cycle of A. 



By Corollary 3.1 property (5) implies that the tropical eigenvector m in this case is unique. 
Property (4) implies rm — rrii+i = A^r^u — A for all i. By (2) and (3), there exists j E {1, . . . , n} 
such that >L_(j +1 ) > A for all i < j, and -Awj+i) < A for all i > j. This implies 

nij < rrij-i < . . . < mi < m n < . . . < rrij+i. 

Hence A is the matrix needed. □ 
For HodgeRank and Principal Eigenvector 



By Corollary 3.1, this result follows immediately from the above by a limit argument. Specif- 
ically, let X be a matrix that induces the ranking ((71,02) on the pair HodgeRank and Trop- 
ical Eigenvector. Let e := min|m(X)j — m(X)j\. By Corollary 



3.1 



one can choose suffi- 



ciently large k such that the matrix Y := X^ satisfies |i>i(Y") — irii(X)\ < e/3 for all i. So 



r(v(Y)) = r(m(X)) = 02, and by Lemma 2.2, r(h(Y)) = o\. Hence Y is a matrix that realizes 



the pair (a\,U2) for HodgeRank and Principal Eigenvector. □ 



For Tropical and Principal Eigenvector 
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To find the desirable X in Lemma 4.1 we consider a family of matrices called perturbed 
comparison matrices, first introduced by Astuti and Garnadi [15] and a year later by Farkas 
[3]. These are strongly transitive MPCMs with the first row and column perturbed by a noise 
vector. Explicit formulae for the principal eigenvalue and eigenvector are given in pH 115]. 

For our case, fix a number L > 1, L G Q. Define s G 1" by 

Si = 1 for all £ < n, s n = — . 



Let the upper-diagonal entries of X G X be 



1 



Xij = — if i ^ 1, = — • <5j 



where 5 = (82, ■ ■ ■ , S n ) G 



Then 



} n 1 is the noise vector, with 

62 < S3 < . . . < 5 n -i = L, and 5 Tl 



1 

L2 



(4) 



X 



1 

S 3 



L 

L 



82 
1 
1 



1 

L 



1 
1 



1 

L 



1 L 
1 L 



1 L 

i 1 



By |15j , the principal eigenvector v of X is 

v = ct\e\ + «2S + 031^ 

where 



ei 



1 

h- > 




1 









1 







,s = 


1 


,W = 
















1 

. L . 





1 



1 __ 

1 fx 



1 



and a := (ai, 02,0(3) is a column vector of the adjugate matrix adj(rl — Z), where I is the 
identity matrix, and 

" a b 
1 n c 
1 1 



Z :-- 



with 



i=2 



a = J2(Si-l), 6 = ^-1) 

i=2 i=2 

and r is the principal eigenvalue of Z, that is, it is the root of maximal modulus of the charac- 
teristic polynomial 

p(t) = t 2 (t - n) + b(n - 1) - ac. (5) 

Since L > 1 is the maximal element in each row, m(X) = (1,...,1). By Lemma |4.1| it is 
sufficient to prove that there exists choices of 5 such that v(X) induces a complete ranking. 
In fact, we claim that any rational 5 satisfying Equation Q would do. Indeed, computing an 
explicit formula for a, we obtain 



a 1 



(r — n)r — c, 02 = r + c, 03 



71+1. 
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Then, 

Vi 
V n -1 
Vn 

Note that v% is a quadratic in r, while Vi are linear for i > 1. Since the S^s are distinct, V{ ^ Vj 
for all 2 < i,j < n — 1. Suppose v\ = Vi for some % ^ 1, or v n = Vi for some i ^ n. In the 
first case, r is a root of a quadratic with coefficients in Q, In the second case, r is a root of a 
linear equation with coefficients in Q. Either cases imply the cubic p in Equation ^ must be 
factorisable into a quadratic times a linear term over Q. That is 

p(t) = t 3 - nt 2 + b(n -l)-ac= (t 2 + et + l)(t - g) for some e,g G Q 

Equating coefficients, we have eg 1 = 1, e — 5 = — n, and 6(n — 1) — ac = —5. The first two 
equations imply 1/g — g + n = 0, hence g = (n — \/n 2 + 4) /2 or (n + \/n 2 + 4) /2. But j £ Q, 
therefore n 2 + 2 2 must be a square natural number, since n G N. However, there is no positive 
Pythagorean triple involving 2, hence no such g exists. Therefore, the v^s are all distinct. □ 



r — n)r — c + r + c = (r — n + l)r 
1 



r + c+(r — n + 1 
r + c+(r — n + 1 



(r + c) • - + (r - n + 1) • - f 



lj for 2 < i < n - 1 

/ 1 l 



4.1. Realizability of ranking triples. It is natural to ask whether all ranking triples can be 
realized. For n = 3, the answer is no. 

Corollary 4.2. For n = 3, if X G X , then h{X) = m{X) = v(X) (up to scaling). That is, all 
methods produce the same score vector, and hence the same ranking. 

The result is a direct computation: if X G X is not strongly transitive, there can be only 
one maximal cycle of length 3, hence the tropical eigenvector is always unique. In this case, 
one can plug in the formula for the HodgeRank vector (as row geometric mean) to verify that 
it is indeed also the tropical and principal eigenvector of X. We can also see this geometrically 
in A for the pair HodgeRank and Tropical Eigenvector: in this case ST ± , viewed as vectors 
of the upper-diagonal entry, is spanned by the vector (1,-1,1). Hence the standard 3-cube 
centered at A will always hits ST at either the corner A + A max • (1, —1, 1), or the opposite 
corner A + A max • (—1, 1, —1), therefore h(A) = m(A) for all A £ A. 

The case n > 3 is substantially more diffic ult. I f one thinks of each matrix X G X as being part 



of a family {X^ : k > 0}, then Corollary 3.1 implies that Principal and Tropical Eigenvector 



induce different rankings only on a finite interval. In general, we do not about the behavior of the 
principal eigenvector as k — > 0, and the transition in induced ranking as k — > 00. Interestingly, 
simulation results suggest the following. 

Conjecture 4.3. As k — > 0, the induced ranking of Principal Eigenvector converges to that 
induced by HodgeRank. 

Since components of the normalized principal eigenvector vary smoothly with k, the conjecture 
suggests that not all ranking regions may be realizable, especially when the ranking induced by 
HodgeRank and Tropical Eigenvector agree, since in this case the ranking induced by Principal 
Eigenvector is 'sandwiched' between these two. This is illustrated in the example below. 
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Example 4.4. Here our matrix X G X is 



X = 



1 


1.57 


0.72 


0.70 


0.63 


1 


1.52 


0.65 


1.38 


0.65 


1 


1.57 


1.45 


1.52 


0.63 


1 



The corresponding vectors, normalized to have the first component be 1 and rounded in 3 decimal 
places, are 

v(X) = [ 1 0.991 1.191 1.151 ] => ranking: 3 > 4 > 1 > 2 

h(X) = [ 1 0.942 1.155 1.151 ] => ranking: 3 > 4 > 1 > 2 

m{X) = [ 1 0.979 0.989 0.968 ] => ranking: 1 > 3 > 2 > 4 

One may note that both the matrix X and the corresponding scores do not have 'crazy' entries 
that can intuitively indicate intransitivity. For example, if one uses the consistency index (X(X) — 
n)/(n — 1) suggested by [I], where X(X) is the principal eigenvalue of X, then the consistency 
index for this case is 0.07073, well within the proposed 0.1 recommended cut-off. This indicates 
that the consistency index may not be a good measure of ranking agreement between methods. 




Figure [2] is a plot of the components of the principal eigenvector of X^ over a range of k, 
normalized so vi(X^) = 1. This is represented by the black line. The green, red and blue lines 



PAIRWISE RANKING: CHOICE OF METHOD CAN PRODUCE ARBITRARILY DIFFERENT RANK ORDER15 

are V2 {X^),v 3 (xW) and v 4 {X^), respectively. Note that each Vi is a smooth function in k. 
A change in the induced ranking happens when one curve crosses over another. The sequence 
of induced rankings (in decreasing order) is shown at various marked points on the plot. The 
ranking of Principal Eigenvector agrees with that of Tropical Eigenvector after k = 30. 

Examples like this suggest that not all ranking triples may be realizable. Studying this 
problem would give further information on the relation between the three methods. 



5. Discussions and Open Problems 

While we have completely understood the picture for HodgeRank v.s. Tropical Eigenvector, 
the behavior of the pair Principal and Tropical Eigenvector is still unclear. Our current con- 
struction of matrices realizing a particular ranking pair for these two is somewhat artificial. 
Simulations suggested that one often hit a region of non-trivial ranking pair far more often than 
hitting a perturbed comparison matrix. Recently, Ottaviani and Sturmfels [16] studied char- 
acterizations of matrices with eigenvectors lie in a given subspace, called the Kalman variety. 
To completely answer the question for the pair Principal and Tropical Eigenvector, one needs a 
tropical Kalman variety, and study how it intersects with the usual Kalman variety. 

A directly related question of interest is the following. 

Problem 1: For 'reasonable' probability distributions on e, what is the probability of A falling 
into a region in which some (or all three methods) give different rankings? 

What constitutes as 'reasonable' depends on the problem's context and ease of computation. 
For example, if one considers a uniform distribution on ST ± , then the question reduces to 
computing the relative volumes of the regions of disagreement. We note that these regions 
change depending on the true score vector s, corresponding to a 'signal-to-noise' behavior: if s 
is close to the origin, indicating that the rater does not have a strong preference between items, 
disagreement and false rankings easily occur when the noise is large. 

Problem 2: What happens when A has missing entries? 

Missing entries do occur in practice. For example, it is a known issue in the Analytic Hierarchy 
Process, since raters may be unwilling to perform all (^) pairwise comparisons for large n. A 
number of papers have been devoted to this problem in the literature, mainly in the context of 
HodgeRank and Principal Eigenvector [TJ \T7\ [18] . 

So far the main approach to this problem is interpolation: one attempts to fill out the missing 
entries by maximizing the some measure of consistency of the resulting matrix |18J . From the 
viewpoint of graph theory, missing entries imply we have a subgraph of the complete graph on 
n vertices. pQ proved that if all three-cycles of the corresponding subgraph have value 0, then 
the matrix has a rank-1 completion. It may be interesting to look at low-rank completion of 
AHP matrices, as suggested in the work of |19j . 

A closely related question to both problem 1 and 2 is the following. 

Problem 3: What happens when the number of voters tend to oo, or the number of items tend 
to oo? 

In some sense this is a question on a different scale. Here one would be less worried about small 
differences in ranking (say, a difference by one transposition), but more on how the methods 
compare in terms of statistical optimality and computational efficiency. By studying the behavior 
of these methods in smaller dimensions, one can gain insights on this problem. 
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6. Summary 

In this paper, we considered the problem of obtaining a cardinal ranking from an n x n 
pairwise comparison matrix on additive and multiplicative scales. We studied the mathematical 
properties and connections of three proposed methods: Principal Eigenvector, HodgeRank and 
Tropical Eigenvector. We noted that Tropical Eigenvector can be thought of as a version of 
Principal Eigenvector on additive paired comparison matrices. Our main theorem states that for 
n > 4, all regions of ranking differences can be realized between any pair of these three methods. 
This indicates that the choice of method in practice deserve further study. We interpreted this 
result in the ranking context and listed some future research directions. 
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